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Costs and Benefits of Research 
and Participant Opinion Change 

In order to protect participants in research from potential harm, 
the American Psychological Association has adopted ethical principles for 
the conduct of research (APA, 1973). According to these principles, every 
decision to conduct research with human participants involves an ethical 
dilemma: Do the benefits of the research outweigh, or at least equal, the 
costs of the research? Individual researchers and the committees established 
for the protection of participants are ethically obligated to consider the 
ratio of costs to benefits in making decisions about whether a study should 
be conducted. 

The revision of the Ethical Standards for Research with Human Subjects 
(APA, 1973) prompted several writers to call for empirical research on 
costs and benefits, considering such data an important aid in making 
decisions about ethical dilemmas in designing research procedures (Berscheid» 
Baron, Dermer, & Libman, 1973; Committee on Ethical Standards, 1971, 1972; 
and Gergen, 1973). The present study is concerned with identifying costs 
and benefits of research participation associated with opinion change of 
participants in a program of research conducted by a university psychology 
department. The results of the study could aid the department researchers 
and ethics committee in implementing procedures that minimize the costs 
and maximize the benefits of research participation. 

A number of previous studies have investigated costs and benefits of 
research participation. Among the studies that have addressed costs, the 



ERIC 



Costs and Benefits 
3 

cost that has received the most attention is the use of deception. Carlson 
(1971), Levenson, Gray, and Ingram (1976), and Seeman (1969) have found a 
continuing high frequency of the use of deception in research, thus high- 
lighting the importance of assessing the effects of deception on 
parti ci pants . 

Evidence of the negative effects of deception has been found in a few 
experiments. Wilson and Donnerstein (1976) obtained unfavorable ratings 
of research procedures involving deception. Silverman, Schulman, and 
Wiesenthal (1970) found that participants in deception experiments tend to 
present themselves in a favorable manner in later experiments. Findings 
by Cruder, Stumpfhauser , and Wyer (1977) suggest that the use of deception 
may have the result that participants no longer believe what experimenters 
say. In contrast to the studies cited thus far, Bickman and Zarantonello 
(1978) found no effect of the use of deception on ratings of the harmful- 
ness of the experiments to the participants. The finding by Straits, 
Wuebben, and Majka (1972) that the use of deception negatively affects 
personal value ratings of experiments only if the cover story is obviously 
false suggests that the effects of deception vary with how the deception 
is conducted. In a study concerned with whether debriefing will eliminate 
negative effects of deception, Walster, Berscheid, Abrahams, and Aronson 
(1967) found that false feedback about participants' personalities affected 
their self-ratings even after debriefing, though the effect disappeared in 
a few minutes. In summary, the findings suggest that the use of deception 
can have negative effects, and that debriefing may not eliminate negative 
effects. 
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Invasion of privacy, another cost associated with psychol ogical 
research (Kelman, 1977), has been the subject of only a little empirical 
research. Abramson (1977) found no negative effects of research on sexual 
experiences in a study that employed anonymous questionnaires and careful 
debriefing. Farr and Seaver (1975) found that research procedures involving 
invasion of privacy were rated as less threatening to participants than 
procedures involving psychological or physical stress. 

There is additional evidence of negative effects of research procedures 
that employ psychological or physical stress. In a study of psychological 
stress, Glasgow, Sadowski , and Davis (1977) found that the scientific value 
of an experiment was a more significant factor in judgments of the 
ethical ity of the experimental procedures when psychological stress was 
involved than when it was not employed. Ring, Wallston, and Corey (1970) 
found that debriefing reduced participants' feelings of regret in a 
replication of the Milgram experiment, a finding that suggests that the 
negative effects of psychological stress can be decreased through debriefing. 
In a study of physical stress, Berscheid et. al (1973) found that debrief- 
ing did not eliminate the negative effect on participants' willingness to 
participate when participants complied with instructions for a physically 

harmful procedure. 

The present literature review located research on only one benefit 
associated with research participation: the scientific value of the experi- 
ment. Glasgow et al . ' s (1977) results indicate that Judgments of the 
ethical ity of an experiment are influenced by its scientific value. 

The research evidence that has been reviewed has important implications 
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for estimating the significance of costs and benefits associated with 
psychological research. However, with the exception of the Ring et al . 
(1970) study, none of the research has been conducted in actual research 
situations. Most of the studies used descriptions of experiments or 
simulated participation to obtain data. Though the studies are high in 
internal validity, their external validity, the general izabil ity of the re- 
sults to actual research situations, is problematic. The present study is 
an assessment of costs and benefits associated with participant opinion change 
in a large program of ongoing research. Significant results will have 
direct implications for changes in the conduct of this program of research. 
To the extent that the results of the present correlational field study 
corroborate the findings of previous experimental findings, we can be more 
confident that both types of studies have identified costs and benefits 
that have positive or negative effects on research participants in vivo_. 

The work of Berscheid et al , (1973) and a preliminary survey by the 
authors (Bloch & Watson, Note 1) have demonstrated the utility of multiple 
criteria for assessing the impact of costs and benefits on participants. 
The current study thus employs multiple outcome criteria to investigate the 
relationship? between several costs and benefits of research participation 
and opinion change in participants. As in many psychology departments, 
students in Introductory Psychology are encouraged to participate in ex- 
periments as part of the educational process. Students are allowed to write 
a short paper rather than participate in experiments if they prefer. The 
department in which the research was conducted attempts to follow the principles 
for the conduct of research set forth by the Pjnerican Psychological Association 
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(1973). A departmental research ethics committee, under the aegis of an 
inst.itution-wide research etdics conmittee, reviews all research proposals 
and determines whether the research satisfies the APA's ethical guidelines. 

At the beginning of the spring semester, 1979, a total of 491 students 
in two sections of Introductory Psychology were given a questionnaire asking 
for their opinions of psychological research, rese^archer truthfulness, and 
for a racing of their willingness to voluntu^n"ly participate in research. 
Decreases in any of these items is a cost of research which 1s the ethical 
responsibility of investigators to minimize, according to A. P. A. Ethical 
Principles- For the items on willingness to volunteer and opinion of 
psychological research each subject was asked to circle one of fi^' possible 
choices for each, ranging from very willing or very high opinion to very 
unwilling or very low opinion. On the question concerning researcher 
truthfulness subjects had to choose from three choices which included: 
psychologists were deceiving, over-simplifying, or as truthful as possible 
when informing participants of the nature of a study. At the end of the 
same semester, a second questionnaire v/as administered to the same classes 
which included the same questions on opinions of research, researcher 
truthfulness, and willingness to volunteer. Questions on the frequency 
with which students experienced the following costs and benefits were also 
included on the second questionnaire: informed of a deception, suspected 
a deception, experienced anxiety, learned about research in general, learn- 
ed about a specific research topic, felt free to discontinue participation, 
were treated with respect, were informed of the nature of the experiment 
at the start, informed of the nature of the experiment at the end, never 
informed of the nature of the experiment, and given an oversimplified 
explanation of the experiment. Of interest was the extent of and direction 
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of opinion change students would show as a result of their experiences and 
the relationships between the particular costs and benefits and particular 
opinion changes. 



RESULTS and DISCUSSION 

Completed pairs of questionnaires were obtained from 332 students, or 68% 
of all the students registered for the sections. The majority of the 
students did not change their opinions of psychological research (59%), 
researcher truthfulness (73%), or their willingness to volunteer (56%). For 
students whose opinions changed, they tended to grow more negative over the 
three opinions (X2(2)=7.82, p<.02). The findings that a majority of 
participants did not change their opinions and that those who did change 
tended to become more negative are apparent In figure 1, which presents the 
direction of opinion change for the three criterion variables. Figures 2, 
3, and 4 present the initial and final opinion levels for each of the 
criterion variables. It Is apparent from these that both Inltal and final 
opinions are generally favorable. 

Chi square tests of association were used to test for relationships 
between each cost or benefit variable and each change in criterion opinion. 
Initially, the direction of opinion change was tested as a function of the 
number of experiments containing each cost or benefit. When opinion change 
was associated with the frequency of occurence of a cost or benefit, it was 
found that there were two possible sources of relationship: opinions 
changed in a particular direction the more frequent the cost or benefit was 
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experienced, or the frequency of a cost or benefit was related to the 
probability of opinion change in either direction, up or down^ These two 
possible sources of relationship were tested for all the significant 
relationships between opinion change and cost or benefit frequency^ In 
order to determine whether a cost or benefit vms related to the direction of 
opinion change, the frequency of a cost or benefit experience was compared 
between subjects whose opinions went up and those who went down. Separata 
chi square analyses determined whether the same experiences were related to 
likelihood of opinion change by pooling the subjects whose particular 
opinions changed up or down and comparing their cost or benefit frequency to 
that of the subjects whose opinions did not change^ 

Directional opinion changes were associated with two cost variables: 
known and suspected participation in deception experiments. Opinions of 
psychological research (X2(l)=8.60, p<.01) and researcher truthfulness 
(X2(l)=8.13, p<.01) were both negatively related to experiencing deception, 
while only worsening opinions of researcher truthfulness were associated 
with suspecting a deception (X2(l)=7.02, p<-01). These data provide 
evidence of negative effects of deception research on part icipants • 
Interestingly, there were no consistent changes in the third opinion 
variable, willingness to participate in further research, as a function of 
deception. 

Changes on all three opinion criteria occurred with increased frequency 
in experiments in which the participants did not experience the benefit of 
learning about researcn in general (Willingness X2(l)='7-52, p<.OI: Research 
X2(I)=11.42, p <.00I: Truthf ullness X2(I)»I4.81, p<.001). However, there 
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was no consistent direction to the opinion changes. Restated^ the more 
likely a subject was to learn about t*3search, the less likely was a change 
in any of the criterion opinions. Wlien opinions were changed, they were as 
likely to go up as down. Examination of the people whose opinions went down 
revealed that their initial opinions were quite high, vhile the opposite was 
true for those whose opinions went up (for example see table !)• This 
suggests the possible operation of a regression toward the mean for extreme 
groups. However, such a regression do«^.s noL account for the finding that 
learning about research reduced the likelihood of opinion change. 

One plausible interpretation is that probability of opinion change is a 
function of initial expectations. Research participants expecting to learn 
about research may be maintained in their opinions when that expectation is 
confirmed. There Is ample basis for thinking that initial expectations for 
learning about research, for example, were high. The Psychology 
Department ''s announced rationale for research participation by introductory 
students was that it would complement their learning in class- Further, the 
initial scores given for the opinions of psychological research (Fig. 2), 
researcher truthfulness (Fig. 3), and willingness to volunteer (Fig. 4) were 
generally high suggesting generally high expectations. If participants had 
high i:iitial expectations about learning about research, and if having their 
expectations met would reduce the probability of changing their opinion, 
there should be higher expectations In subjects whose opinions did not 
change and who felt they had learned about research. Table 2 presents the 
initial ratings on opinions of psychologist truthfulness, as an approximation 
of initial expectations on learning about research, as a function of 
learning experiences for the group whose opinions did not change. The 
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subjects exporionclng the iroiit learning about '^uiw^arcli did sh(>w t hl/hcst 
initial opinions. Positive correlations betVL^cn the indivl ^Mal's Ir.irnlnr. 
experiences and their i^nitlal opinions of psy clio 1 o\> 1 ca 1 '^s..Mrch 
(r(330)=.31, p<.01) and rcGoarchcr t ru th f u Inu.ss (r(330)-. 30, y.<^J{), also 
reflect the Inportance of initial opinions In laf 1 tuMicM t^b^> p< ^ r < t i on of, 
or reaction to, subscc^uent costs and brtufits. 

In addition tn the benefit of learning aboat research, several other 
costs and benefit variables are related to the likelihood of opinion chan^^e 
but not to the direction of opinion change. Four costs or lack of benefits 
were associated with increased frequencies of opinion cliange on the 
criterion of researcher truthfulness: exp ericncing anxiety ( /^(l)^-6.27, 
p<.05), not feeling free to discontinue participation (X2(l)=9.31, p<.Ol), 
not being treated with respect (X2 ( 1 ) = 1 0 . 28 , p<.01), and not being inforuK^d 
of the nature of the experimen^ at the start (X2 ( 1 ) = 1 5 . 4 7 , p<.OI). 
Int eres t ingly > of these variables only the experience of not feeling free to 
discontinue participation was related to change on a second criterion: 



opinion of psychological research (X2(l)=4.51, p<.05). Receiving 
oversimplified explanations was related to willingness to voiunLeer. Again, 
these relationships are interpreted as reflecting important variables which 
interact with initial expectations to influence the probality of opinion 
change* In individual instances this interaction may influence the 
direction of opinion change as well. 

The matrix of correlations among the cost and benefit variables showed 
several interesting relationships since many of the costs and benefits were 
relatively highly cor elated with each other. All the correlations to be 
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f* ,rii wl!i iMpr.^vil of nv^virch review coiii:n 1 1 tecs Independent 

I ..-fit'* to iho itiwNut tt^'.r.irrhor' s )»rowth nnd ve lopmc^nt . 

t .^i' i y orc« r.»:r. i i?<MMt ! oil ^;ho^!^d be }»Ivcmi to monns of 
. , M alt»i nt rpt Ion. Tin- i> xp e r 1 t^nce of being 

. ,i f :.,r,i<,' th.- f^pt-r l;:unL hi this tMiv 1 ronniont led, on the one 

.-c t ?. .'!t- l)olny\ losportoil. On the otbt^r hand, the 

. . . ... i.i- 1[0.m: 'A .1 .!»*iiMpilon \K'i\ r:o n^^v»a^ v:han^os on more 

,,i i>;.^ .>i i . w .»! ar.pt-i-t tin; a <li» rop t 1 on . Thus, the attempt 

M . ij,. l.»n !>v ^l<bi 1 '-t J np, may not nrc.-'isarlly be effective. Tn 

[ i . > *• t f hai 'tiil rhati no ih» h i I o f i np, • 

-ittli'ltv?" Mltlp^t* oniric. :io vTitoria In evaluatinj^ the Impact 
, , tjirh n '.Ai . also drcio a t iM t Pbe various crLterton 

... iMf lu. ar. vl by .lllloxont i.vit and bom^fit i^xperloncos (table 

, t ,M ,n only <M^t* r i I t .mM on would provl<le an inadequate 

M.Mi .o lb.' I p.i. t ot a rt'-o'artdi prop.ram. ConvL-rsely, the more 

,^.»( 1 ..a[r tlu^ =;iofe rnnplete will be the a s s cv; sine n t of a 

. h .>vftall c os t -1^ o ne 1 i t ratio. 
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Table 1 

Initial Opinions of Researcher Truthfulness for Participants I'Jhose Opinions 

Changed 

Opin. Down Opin. UNCHANGED Opin. Up 

Low 0 5 13 

Init. 

Med 8 25 31 

Opin. 

High 38 211 1 
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Table 2 



Initial opinions of psychologist truthfulness as a function of learning 
experiences for the group which did not change opinion.- 



Number of learning experiences 
0 12+ 

Low 2 2 1 

«^ 

Init. 

Med 13 3 9 

Opin. 

High 58 45 108 
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Table 3 



Sunmiary of relationships between costs and benefits and opinion change, 



Opinion of Psychological Research 
Learning about research 

Not feeling free to discontinue participation 
Being informed of a deception"'^* 



Opinion of Psychologist Truthfulness 

Learning about research 
Experiencing anxiety 

Not feeling free to discontinue participation 
Not being treated with respect 
Not being informed at the start 
Being informed of a deception** 
Suspecting a deception** 



Willingness to Volunteer 

Learning about research 

Receiving overs itnpl if led explanations 



** Relationship was directional- 
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